Method and mobile terminal for displaying information, method and display device for providing information, and method and mobile terminal for generating control signal

ABSTRACT

A method in which a mobile terminal displays information is provided. The method includes: transmitting, to an external display device, a first signal for selecting an object displayed on the external display device based on a first input of a user through the mobile terminal; transmitting, to the external display device, a second signal for requesting additional information corresponding to the selected object based on a second input of the user through the mobile terminal; and displaying, on a screen of the mobile terminal, the additional information received from the external display device.

CROSS-REFERENCE TO RELATED PATENT APPLICATION

This application is a continuation application of U.S. patentapplication Ser. No. 13/950,507, filed on Jul. 25, 2013, which claimspriority from Korean Patent Application No. 10-2012-0081434, filed onJul. 25, 2012, in the Korean Intellectual Property Office, thedisclosures of which are incorporated herein in its entirety byreference.

BACKGROUND

1. Field

Exemplary embodiments relate to a method and mobile terminal fordisplaying information by selecting an object displayed on an externaldisplay device based on an input of the mobile terminal and obtainingand displaying additional information corresponding to the selectedobject, a method and display device for providing information byselecting an object based on an input of a mobile terminal and providingadditional information regarding the selected object to the mobileterminal, and a method and mobile terminal for generating a controlsignal by changing a received user input to the control signal based onan operating mode of the mobile terminal.

2. Description of the Related Art

A smart television (TV) is a multifunctional TV capable of utilizingvarious functions such as web surfing, video on demand (VOD) watching, asocial networking service (SNS), a game, etc. by combining a TV and anInternet access function and installing various applications.

One characteristic of the smart TV is that a user and the TV cantransmit and receive information from each other. This is a differencebetween the smart TV and an existing TV that merely transfersinformation unilaterally. Thus, the smart TV is also referred to as aninteractive TV.

However, it is very inconvenient for the user to use the variousfunctions of the smart TV by using a standard remote controller. Inparticular, when the user browses or downloads contents, the user needsto manipulate the remote controller through several steps.

Therefore, a control device or system for allowing the user to easilycontrol the smart TV is needed.

SUMMARY

Exemplary embodiments provide a method and mobile terminal fordisplaying information by selecting an object displayed on an externaldisplay device based on an input of the mobile terminal and obtainingand displaying additional information corresponding to the selectedobject.

Exemplary embodiments also provide a method and display device forproviding information by selecting an object based on an input of amobile terminal and providing additional information regarding theselected object to the mobile terminal.

Exemplary embodiments also provide a method and mobile terminal forgenerating a control signal by changing a received user input to thecontrol signal based on an operating mode of the mobile terminal.

According to an aspect of an exemplary embodiment, there is provided amethod in which a mobile terminal displays information, the methodincluding: transmitting a first signal for selecting an object displayedon an external display device to the external display device based on afirst input of a user through the mobile terminal; transmitting a secondsignal for requesting additional information corresponding to theselected object to the external display device based on a second inputof the user through the mobile terminal; and displaying, on a screen ofthe mobile terminal, the additional information received from theexternal display device.

The transmitting of the first signal for selecting the object mayinclude: converting the signal for selecting the object according to acontrol protocol of the external display device.

The transmitting of the first signal for selecting the object mayinclude: transmitting a signal for controlling a movement of a selectionregion for selecting the object displayed on the external displaydevice.

The transmitting of the signal for controlling the movement of theselection region may include: transmitting a signal for controlling atleast one of a movement direction of the selection region, a movementspeed of the selection region, and a number of objects displayed on ascreen of the external display device based on the first input.

The transmitting of the first signal for selecting the object mayinclude: displaying thumbnail information of contents corresponding tothe object on the screen of the mobile terminal.

The thumbnail information may include at least one of an image of thecontents corresponding to the object, a title of the contents, and atype of the contents.

The transmitting of the first signal for selecting the object mayinclude: displaying a movement direction of the mobile terminal on thescreen according to the first input.

The first input and the second input may include at least one of amotion input, a key input, a touch input, a bending input, and a voiceinput.

The first input may include a three-dimensional (3D) motion input formoving the mobile terminal in a 3D direction, wherein the second inputincludes a rotational motion input for rotating the mobile terminal bymore than a predetermined angle.

The transmitting of the second signal for requesting additionalinformation may include: receiving the additional information from thedisplay device.

The transmitting of the second signal for requesting additionalinformation may include: receiving link information of the additionalinformation from the external display device based on the second input;and receiving the additional information from a server based on thereceived link information.

The transmitting of the first signal for selecting the object to thedisplay device may include: requesting control authorization from theexternal display device; and receiving a control authorizationacceptance message from the external display device.

The contents may include at least one of a still image, a moving image,an application, music, a web page, and an electronic program guide(EPG).

The additional information may include at least one of previewinformation, prelistening information, application information, userreview information, update information, newspaper article information,goods information, movie information, game information, advertisementimage information, and album information.

The method may further include: controlling the additional informationdisplayed on the screen of the mobile terminal based on a third input ofthe user through the mobile terminal.

The controlling of the additional information may include: controllingat least one of displaying of the additional information, playing of theadditional information, and changing to previous additional informationor next additional information based on the third input of the userthrough the mobile terminal.

The method may further include: obtaining contents corresponding to theadditional information displayed on the screen of the mobile terminal.

According to an aspect of another exemplary embodiment, there isprovided a method in which a display device provides information to amobile terminal, the method including: selecting an object displayed onthe display device by receiving a first input of a user through themobile terminal; and transmitting additional information correspondingto the selected object to the mobile terminal by receiving a secondinput of the user through the mobile terminal.

The transmitting may include: extracting the additional information fromcontents corresponding to the selected object.

The selecting of the object may include: receiving a control signal forcontrolling a movement of a selection region for selecting the objectfrom the mobile terminal; and moving the selection region according tothe control signal.

The selecting of the object may include: converting the received firstinput to a control signal for controlling a movement of a selectionregion according to a control protocol of the display device.

The receiving may include: receiving the control signal for controllingthe movement of the selection region from each of a plurality of mobileterminals.

The method may further include: sensing at least one of the first inputof the user through the mobile terminal and the second input of the userthrough the mobile terminal.

The selecting of the object may include: controlling at least one of amovement direction of the selection region, a movement speed of theselection region, and a number of objects displayed on a screen based onthe first input of the user through the mobile terminal.

The selecting of the object may include: transmitting thumbnailinformation of contents corresponding to the object to the mobileterminal.

The transmitting of the additional information to the mobile terminalmay include: transmitting link information of the additional informationto the mobile terminal.

The terminal may further include: receiving a request for transmissionof contents corresponding to the selected object from the mobileterminal; and transmitting the contents corresponding to the selectedobject to the mobile terminal.

According to an aspect of another exemplary embodiment, there isprovided a mobile terminal including: a communication unit which isconfigured to transmit a signal for selecting an object displayed on anexternal display device to the external display device based on a firstinput of a user through the mobile terminal; an additional informationobtaining unit which is configured to transmit a signal for requestingadditional information corresponding to the selected object to theexternal display device based on a second input of the user through themobile terminal; a display which is configured to display the additionalinformation received from the external display device; and a controllerwhich is configured to control the communication unit, the additionalinformation obtaining unit, and the display unit.

The controller may convert the signal for selecting the object accordingto a control protocol of the external display device.

The communication unit may transmit a signal for controlling a movementof a selection region for selecting the object displayed on the externaldisplay device.

The communication unit may transmit a signal for controlling at leastone of a movement direction of the selection region, a movement speed ofthe selection region, and the number of objects displayed on a screen ofthe external display device based on the first input.

The display may display thumbnail information of contents correspondingto the object on a screen of the mobile terminal.

The additional information obtaining unit may receive the additionalinformation from the external display device.

The communication unit may receive link information of the additionalinformation from the external display device based on the second input,and wherein the additional information obtaining unit receives theadditional information from a server based on the received linkinformation.

The controller may control the additional information displayed on themobile terminal based on a third input of the user through the mobileterminal.

The mobile terminal may further include: a contents obtaining unit whichis configured to obtain content corresponding to the additionalinformation displayed on the mobile terminal.

According to an aspect of an exemplary embodiment, there is provided adisplay device including: a selection unit which is configured to selectan object displayed on the display device based on a first input of auser through a mobile terminal; a communication unit which is configuredto transmit additional information corresponding to the selected objectto the mobile terminal by receiving a second input of the user throughthe mobile terminal, and a controller which is configured to control theselection unit and the communication unit.

The controller may extract the additional information from contentscorresponding to the selected object.

The selection unit may receive a control signal for controlling amovement of a selection region for selecting the object from the mobileterminal and move the selection region according to the received controlsignal.

The controller may convert the received first input to a control signalfor controlling a movement of a selection region according to a controlprotocol of the display device.

The display device may further include: a sensor which is configured tosense at least one of the first input of the user through the mobileterminal and the second input of the user through the mobile terminal.

The controller may control at least one of a movement direction of theselection region, a movement speed of the selection region, and a numberof objects displayed on a screen based on the first input of the userthrough the mobile terminal.

The communication unit may transmit link information of the additionalinformation to the mobile terminal.

The communication unit may receive a request for transmission ofcontents corresponding to the selected object from the mobile terminaland transmit the contents corresponding to the selected object to themobile terminal.

According to an aspect of another exemplary embodiment, there isprovided a method in which a mobile terminal generates a control signal,the method including: receiving a user input; determining an operationmode of the mobile terminal; and in response to determining theoperation mode is a first mode, generating a first control signal forcontrolling an external display device based on the user input, and, inresponse to determining the operation mode is a second mode, generatinga second control signal for controlling contents displayed on the mobileterminal based on the user input.

The contents may include contents corresponding to an object selectedfrom the external display device or additional information correspondingto the object based on the first control signal.

The user input may include at least one of a motion input, a key input,a touch input, a bending input, and a voice input.

The determining may include: determining the operation mode of themobile terminal as the first mode in a case where the mobile terminal isin a vertical mode, and, determining the operation mode of the mobileterminal as the second mode in a case where the mobile terminal is in ahorizontal mode.

The determining may include: determining the operation mode of themobile terminal based on information displayed on a screen of the mobileterminal.

The determining may include: in response to determining the informationdisplayed on the screen of the mobile terminal is thumbnail informationof contents corresponding to the object displayed on the externaldisplay device or movement direction information of the mobile terminal,determining the operation mode of the mobile terminal as the first mode,and, in response to determining the information displayed on the screenof the mobile terminal is the contents corresponding to the objectdisplayed on the external display device or additional informationcorresponding to the object, determining the operation mode of themobile terminal as the second mode.

The generating of the first control signal may include: converting thefirst control signal according to a control protocol of the externaldisplay device.

The first mode may be a mode in which the object of the external displaydevice is selected, and the second mode is a mode in which additionalinformation corresponding to the selected object is displayed on themobile terminal.

The first control signal may include a signal for controlling a movementof a selection region for selecting the object of the external displaydevice, and the second control signal may include a signal forcontrolling at least one of playing of the contents, editing of thecontents, and transmission of the contents.

The method may further include: receiving a first rotational motioninput for rotating the mobile terminal in a first direction by apredetermined angle; converting the operation mode from the first modeto the second mode based on the first rotational motion input; receivinga second rotational motion input for rotating the mobile terminal in asecond direction by the predetermined angle; and converting theoperation mode from the second mode to the first mode based on thesecond rotational motion input.

According to an aspect of another exemplary embodiment, there isprovided a mobile terminal including: a user input which is configuredto receive a user input; an operation mode determining unit which isconfigured to determine an operation mode of the mobile terminal; and acontroller which is configured, in response to the operation modedetermining unit determining that the operation mode is a first mode,generate a first control signal for controlling an external displaydevice based on the user input, and, in response to the operation modedetermining unit determining that the operation mode is a second mode,generate a second control signal for controlling contents displayed onthe mobile terminal based on the user input.

The user input may receive a first rotational motion input for rotatingthe mobile terminal in a first direction by a predetermined angle and asecond rotational motion input for rotating the mobile terminal in asecond direction by the predetermined angle, and wherein the controllerconverts the operation mode from the first mode to the second mode basedon the first rotational motion input and the operation mode from thesecond mode to the first mode based on the second rotational motioninput.

According to an aspect of another exemplary embodiment, a method ofdisplaying information of an external display device on a mobileterminal displays is provided. The method includes: receiving a userinput into the mobile terminal about an object displayed on the externaldisplay device; transmitting a first signal to the external displaydevice to select the object displayed on an external display device;receiving a second user input into the mobile terminal about additionalinformation corresponding to the object displayed on the externaldisplay device; transmitting a second signal to the external displaydevice to request additional information corresponding to the selectedobject; and displaying, on a screen of the mobile terminal, theadditional information received from the external display device.

The transmitting the first signal may include converting the firstsignal to a control protocol of the external display device.

The transmitting the first signal may include requesting controlauthorization from the external display device and receiving a controlauthorization acceptance message from the external display device.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features and advantages will become more apparent bydescribing in detail exemplary embodiments with reference to theattached drawings in which:

FIG. 1 is a view for explaining an information providing systemaccording to an exemplary embodiment;

FIG. 2 is a view for explaining an information providing systemaccording to another exemplary embodiment;

FIGS. 3A through 3C are views of screens on which a mobile terminalselects an object of an external display device, according to anexemplary embodiment;

FIGS. 4A and 4B are views of screens on which a mobile terminal obtainsadditional information, according to an exemplary embodiment;

FIG. 5 is a view of a screen on which contents are obtained, accordingto an exemplary embodiment;

FIG. 6 is a view of a screen on which an object is displayed orreproduced, according to an exemplary embodiment;

FIG. 7 is a flowchart illustrating a method in which a mobile terminaldisplays information, according to an exemplary embodiment;

FIG. 8 is a detailed flowchart illustrating a method in which a mobileterminal displays information, according to an exemplary embodiment;

FIG. 9 is a flowchart illustrating a method in which a display devicesenses an input of a mobile terminal and provides additionalinformation, according to an exemplary embodiment;

FIG. 10 is a flowchart illustrating a method in which a mobile terminalobtains additional information through a server, according to anexemplary embodiment;

FIG. 11 is a flowchart illustrating a method in which a mobile terminalobtains contents, according to an exemplary embodiment;

FIG. 12 is a flowchart illustrating a method in which a mobile terminalobtains contents through a server, according to an exemplary embodiment;

FIG. 13 is a view of a screen on which each of a plurality of mobileterminals selects an object of a display device, according to anexemplary embodiment;

FIG. 14 is a block diagram of a mobile terminal, according to anexemplary embodiment;

FIG. 15 is a block diagram of a display device, according to anexemplary embodiment;

FIG. 16 is a flowchart illustrating a method in which a display deviceprovides information, according to an exemplary embodiment; and

FIG. 17 is a flowchart illustrating a method in which a mobile terminalgenerates a control signal, according to an exemplary embodiment.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

First, the terms used herein will be briefly described, and then theexemplary embodiments will be described in detail.

Although the terms used herein are general terms that are widely used atpresent in consideration of the functions of the exemplary embodiments,they may vary according to the intention of one of ordinary skill in theart, a precedent, the appearance of new technology, or the like. Inaddition, in a particular case, the applicant may select the termsarbitrarily. In this case, the meanings of the terms will be describedin detail in the detailed description of the exemplary embodiments.Thus, the terms used in the detailed description should not be onlynames of the terms but should be defined based on their meanings andcontents in relation to the exemplary embodiments.

When a unit “comprises” an element in the entire specification, the unitdoes not exclude another element but may further comprise anotherelement unless the context clearly indicates otherwise. In addition,terms such as “ . . . unit”, “module”, and the like used herein indicatea unit for performing at least one function or operation and may beimplemented by hardware or software or a combination thereof.

Throughout the specification, an “object” refers to a target that may beselected by a user from a display device. Examples of the objectinclude, but are not limited to, an icon, a link, a picture, a text, anindex item, etc.

In addition, “additional information” refers to information regardingcontents corresponding to an object, and may have various formsaccording to types of contents. Examples of the additional informationmay include, but are not limited to, preview information, prelisteninginformation, application information, user review information,advertisement image information, update information, newspaper articleinformation, goods information, movie information, game information,album information, etc.

In the present specification, “contents” may be displayed, reproduced,or stored in a mobile terminal, and may include, for example, stillimage contents (for example, a photo, a picture, etc.), text contents(for example, an electronic book (a poem and a novel), a letter, abusiness file, a web page, an electronic program guide (EPG), etc.),moving image contents (for example, a personal image, a movie, musicvideo, a YouTube video, a TV program image, etc.), music contents (forexample, music, a music performance, a radio broadcast, etc.), anapplication (a widget, a game, etc.)

The exemplary embodiments will now be described more fully withreference to the accompanying drawings. The exemplary embodiments may,however, be embodied in many different forms and should not be construedas being limited to the embodiments set forth herein; rather, theseembodiments are provided so that this disclosure will be thorough andcomplete, and will fully convey the inventive concept to those ofordinary skill in the art. For clarity, in the drawings, irrelevantportions with respect to the description are omitted, and similarreference numbers are added to similar portions throughout the entirespecification.

As used herein, the term “and/or” includes any and all combinations ofone or more of the associated listed items. Expressions such as “atleast one of,” when preceding a list of elements, modify the entire listof elements and do not modify the individual elements of the list.

FIG. 1 is a view for explaining an information providing systemaccording to an exemplary embodiment.

Referring to FIG. 1, the information providing system according to anexemplary embodiment may include a mobile terminal 100 and an externaldisplay device 200.

The mobile terminal 100 is a device that obtains contents from theoutside and displays, reproduces, or stores the obtained contents. Themobile terminal 100 may be implemented in various ways. For example, themobile terminal 100 described in the present specification may include acellular phone, a smart phone, a laptop computer, a tablet personalcomputer (PC), an e-book terminal, a personal digital assistant (PDA), aportable multimedia player (PMP), a navigation system, etc.

The display device 200 is a device that may be of various typesincluding a display panel. For example, the display device 200 describedin the present specification may include a smart television (TV), anInternet protocol TV (IPTV), a digital TV (DTV), a computer, a laptopcomputer, an e-book terminal, a tablet PC, a digital broadcastingterminal, a consumer electronics (CE) device (for example, arefrigerator or an air conditioner having the display panel), etc.

The display device 200 according to an exemplary embodiment may displayan object list. The object list may include identification informationregarding at least one piece of contents. Examples of the identificationinformation may include a title of contents, an image and iconindicating contents, etc.

FIG. 2 is a view for explaining an information providing systemaccording to another exemplary embodiment.

Referring to FIG. 2, the information providing system according toanother exemplary embodiment may include the mobile terminal 100, thedisplay apparatus 200, and a server 300.

The mobile terminal 100 and the display apparatus 200 are the same asdescribed with reference to FIG. 1, and thus descriptions thereof areomitted.

The server 300 may communicate with the mobile terminal 100 or thedisplay apparatus 200. According to an exemplary embodiment, the server300 may receive a contents providing request from the mobile terminal100 or the display device 200. In this case, the server 300 may providecontents to the mobile terminal 100 or the display device 200. Thecontents provided by the server 300 may be contents corresponding to anobject selected by the display device 200 or additional informationcorresponding to the object.

For example, in a case where the display device 200 selects an objectrelating to movie contents, the server 300 may provide the moviecontents or preview video of the movie contents to the mobile terminal100 or the display device 200.

An example in which the mobile terminal 100 selects an object displayedon an external display device based on a user input and obtains anddisplays additional information corresponding to the selected objectwill now be described in brief with reference to FIGS. 3 through 6.

FIGS. 3A through 3C are views of screens on which the mobile terminal100 selects an object of the external display device 200, according toan exemplary embodiment.

Referring to FIG. 3A, the display device 200 may display a plurality ofobjects indicating a plurality of pieces of contents. In this case, auser may use the mobile terminal 100 to select at least one of theplurality of objects displayed on the display device 200.

For example, the user may move the mobile terminal 100 up and down andleft and right (a first input) to select at least one of the pluralityof objects displayed on the display device 200. In this regard, thedisplay device 200 may display a location of a selection region (forexample, a cursor and a pointer) corresponding to a movement of themobile terminal 100 on a screen.

Although a motion input is exemplarily used as the first input forselecting an object in FIG. 3A, the first input is not limited to themotion input. The first input may be a bending input, a key input, avoice input, and a touch input in addition to the motion input.

According to an exemplary embodiment, the mobile terminal 100 may turnits screen off or may blacken its screen when selecting an objectdisplayed on a screen of the display device 200 in such a way thatuser's eyes are not distracted.

According to another exemplary embodiment, the mobile terminal 100 maydisplay thumbnail information such as an icon, an image, a title, etc.of contents relating to an object in which the selection region isdisposed or a movement direction of the mobile terminal 100 as an arrow,etc. on the display device 200.

Referring to FIG. 3B, the mobile terminal 100 may display a selectionwindow (or a graphical user interface (GUI)) for selecting a category(for example, drama, movie, sports, etc.) of contents. In this regard,the mobile terminal 100 may receive a selection of at least one categoryfrom the user. The mobile terminal 100 may transmit informationregarding the selected category to the display device 200. In this case,the display device 200 may filter and display an object regardingcontents corresponding to the category selected by the user.

Referring to FIG. 3C, the mobile terminal 100 may output a map or a GUIindicating objects displayed on the display device 200 from among allthe objects.

FIGS. 4A and 4B are views of screens on which the mobile terminal 100obtains additional information, according to an exemplary embodiment.

Referring to FIG. 4A, a user may move the mobile terminal 100, select anobject of the display device 200, then rotate the mobile terminal 100,and request additional information corresponding to the selected objectfrom the display device 200.

In this case, the display device 200 may transmit the additionalinformation corresponding to the selected object or link information(for example, a uniform resource identifier (URI)) of the additionalinformation to the mobile terminal 100. In this regard, the mobileterminal 100 may display the obtained additional information on ascreen.

For example, as shown in FIG. 4A, in a case where the user moves themobile terminal 100, selects an object illustrating Shrek, and convertsa vertical mode of the mobile terminal 100 into a horizontal mode, themobile terminal 100 may obtain and display additional information (forexample, Movie Title: Shrek, Review: ★★★★⋆, Representative Image, andAdvertisement Moving Image) relating to Shrek.

According to an exemplary embodiment, referring to FIG. 4B, if the userwishes to select a new object, the user may select the object of thedisplay device 200 again by converting the horizontal mode of the mobileterminal 100 into the vertical mode.

Although a motion input is that an object is selected and then is thatthe mobile terminal 100 receives and displays additional informationcorresponding to the object in FIGS. 3A through 4B as a rotation input,an exemplary embodiment is not limited thereto. That is, according to anexemplary embodiment, the mobile terminal 100 may receive and displayadditional information regarding contents relating to an object in whicha selection region is disposed from the display device 200 whileselecting an object of the display device 200 as the motion input.According to an exemplary embodiment, a communication network over whichthe mobile terminal 100 transmits a signal for selecting an object tothe display device 200 and a communication network over which the mobileterminal 100 receives additional information from the display device 200may be different from each other. For example, the mobile terminal 100may transmit the signal for selecting the object to the display device200 via Bluetooth communication and then receive additional informationcorresponding to the selected object from the display device 200 viaWi-Fi communication.

FIG. 5 is a view of a screen on which contents are obtained, accordingto an exemplary embodiment.

A user may confirm additional information regarding contentscorresponding to an object obtained from the display device 200 and thenrequest the corresponding contents from the display device 200 or theserver 300. For example, the user may confirm additional information(user review, etc.) regarding movie Shrek through the display device 200and then request and download movie contents Shrek from the displaydevice 200 or the server 300.

FIG. 6 is a view of a screen on which an object is displayed orreproduced, according to an exemplary embodiment.

Referring to FIG. 6, according to an exemplary embodiment, the mobileterminal 100 may display or reproduce contents downloaded from thedisplay device 200 or the server 300.

According to another exemplary embodiment, the mobile terminal 100 mayreceive and reproduce contents by streaming the contents.

A method in which the mobile terminal 100 retrieves and/or displaysinformation based on a user input will now be described in detail below.

A method of displaying information according to an exemplary embodimentmay be implemented through a predetermined application. That is, themobile terminal 100 may drive an application for providing the method ofdisplaying information according to an exemplary embodiment. The mobileterminal 100 may drive an application based on the user input orautomatically.

The application driven by the mobile terminal 100 may be an applicationonly for performing a process of controlling the display device 200 orproviding various services. For example, the application may be anapplication for providing a remote control service, a messenger service,a social network service (SNS), a multimedia contents play service, etc.

It is assumed that the method in which the mobile terminal 100 displaysinformation described with reference to FIGS. 7 through 12 may beperformed through a predetermined application.

FIG. 7 is a flowchart illustrating a method in which the mobile terminal100 displays information, according to an exemplary embodiment.Referring to FIG. 7, the method in which the mobile terminal 100displays information according to an exemplary embodiment includesoperations sequentially performed by the mobile terminal 100 of FIG. 14that will be described later. Thus, although omitted below, the abovedescriptions regarding the mobile terminal 100 of FIG. 14 will alsoapply to the method of FIG. 7 in which the mobile terminal 100 displaysinformation.

In operation S710, the mobile terminal 100 may transmit a signal forselecting an object of the external display device 200 to the displaydevice 200 based on a first input. In a case where the first input isreceived, the mobile terminal 100 may generate the signal for selectingthe object of the display device 200 based on the first input.

According to an exemplary embodiment, the mobile terminal 100 mayconvert the signal for selecting the object according to a controlprotocol of the display device 200. That is, the mobile terminal 100 mayobtain identification information (for example, a device type, a deviceID, a device serial number, etc.) of the display device 200 and convertthe first input received from a user to a control command recognizableby the display device 200 based on the identification information of thedisplay device 200.

The signal for selecting the object according to an exemplary embodimentmay include a signal for controlling a movement of a selection region inwhich the object is selected. That is, in a case where the mobileterminal 100 detects a movement that is more than a threshold value, themobile terminal 100 may generate the signal for controlling the movementof the selection region of the display device 200 based on informationregarding the detected movement.

For example, in a case where a gyro sensor value is smaller than thethreshold value, the mobile terminal 100 may determine that the mobileterminal 100 does not move, may not generate the signal for controllingthe movement of the selection region, and, may generate a control signalfor moving the selection region by one space every time the gyro sensorvalue changes by a predetermined value (for example, 10 deg/sec) greaterthan the threshold value.

The signal for selecting the object according to another exemplaryembodiment may include information (for example, movement locationinformation of the mobile terminal 100) regarding the first input. Thatis, the mobile terminal 100 may directly generate and transmit thesignal for controlling the movement of the selection region to thedisplay device 200 or may transmit the information (for example,movement location information of the mobile terminal 100) regarding thefirst input to the display device 200.

In a case where the information (for example, movement locationinformation of the mobile terminal 100) regarding the first input istransmitted to the display device 200, the display device 200 mayconvert the first input to the signal for controlling the movement ofthe selection region according to the control protocol of the displaydevice 200.

For example, in a case where the gyro sensor value smaller than thethreshold value is received, the mobile terminal 100 may determine thatthe mobile terminal 100 does not move and may not generate the signalfor controlling the movement of the selection region. The mobileterminal 100 may generate the control signal for moving the selectionregion by one space every time a predetermined gyro sensor value (forexample, 10 deg/sec) that is greater than the threshold value isreceived.

Before generating the control signal, the mobile terminal 100 may beauthenticated to authorize the display device 200 by the display device200. For example, the mobile terminal 100 may request controlauthorization from the display device 200. In this regard, the mobileterminal 100 may request the control authorization by transmitting theidentification information of the mobile terminal 100 to the displaydevice 200. The identification information of the mobile terminal 100 isunique information for identifying the mobile terminal 100, and mayinclude, for example, a device ID, a unique serial number, a mediaaccess control (MAC) address, an international mobile equipment identity(IMEI), etc.

The display device 200 may authenticate the control authorization of themobile terminal 100 based on the identification information of themobile terminal 100. In a case where authentication is successful, thedisplay device 200 may transmit a control authorization acceptancemessage to the mobile terminal 100. In this case, the mobile terminal100 may control the display device 200.

When transmitting the control authorization acceptance message, thedisplay device 200 may register the identification information of themobile terminal 100 in a storage unit. Thus, although the mobileterminal 100 is not authenticated by the display device 200 any longer,the mobile terminal 100 may control the display device 200.

In operation S720, the mobile terminal 100 may obtain additionalinformation corresponding to the object selected from the display device200 based on a second input. That is, in a case where the second inputis received, the mobile terminal 100 may request the additionalinformation corresponding to the object selected based on the firstinput from the display device 200. In this case, the mobile terminal 100may obtain the additional information from the display device 200 orthrough the server 300. This will be described in detail with referenceto FIG. 8 later.

In operation S730, the mobile terminal 100 may display the obtainedadditional information on a screen. The mobile terminal 100 may displaythe additional information after storing the additional information inthe storage unit by downloading it or may display the additionalinformation by streaming it.

The additional information according to an exemplary embodiment mayinclude preview information, prelistening information, applicationinformation, user review information, advertisement image information,update information, newspaper article information, goods information,movie information, game information, album information, etc.

This will be described in more detail with reference to FIG. 8 later.FIG. 8 is a detailed flowchart illustrating a method in which the mobileterminal 100 displays information, according to an exemplary embodiment.

In operation S810, the mobile terminal 100 may receive a first input.The first input of the mobile terminal 100 may be a motion input (forexample, a 3D motion input, a rotational motion input, etc.), a keyinput, a touch input, a bending input, a voice input, a multimodalinput, etc. That is, a user may move the mobile terminal 100 up (+Yaxial direction) and down (−Y axial direction) and left (−X axialdirection) and right (+X axial direction), touch (flick, drag, tap, pan,etc.) a screen (or a GUI displayed on the screen) of the mobile terminal100 up and down and left and right, manipulate a movement (direction)key, bend a predetermined region (left top, right top, left bottom, andright bottom) of the mobile terminal 100, or input voice including amovement command. In operation S820, the mobile terminal 100 maygenerate a signal for selecting an object based on the first input. Forexample, in a case where the first input is the motion input in whichthe mobile terminal 100 moves up and down and left and right, the mobileterminal 100 may generate a signal for controlling a movement of aselection region according to the movement of the mobile terminal 100.That is, in a case where the user moves the mobile terminal 100 to theleft (−X axial direction) by more than a predetermined value, the mobileterminal 100 may generate a control signal for moving the selectionregion one space to the left.

In a case where the first input is the touch input in which a touchscreen is touched up and down and left and right, the mobile terminal100 may generate a signal for controlling the movement of the selectionregion according to a touch gesture of the user. For example, in a casewhere the user uses a finger or an electronic pen to flick the touchscreen from the left to the right more by than a predetermined distance,the mobile terminal 100 may generate a control signal for moving theselection signal one space to the right.

In a case where the first input is the key input in which the movement(direction) key is manipulated, the mobile terminal 100 may generate acontrol signal for moving the selection region to a locationcorresponding to the direction key.

In a case where the first input is the bending input in which apredetermined region of the mobile terminal 100, which may be formed ofa flexible display, is bent, the mobile terminal 100 may generate acontrol signal for moving the selection region in a directioncorresponding to a bending motion. “Bending” may be a bending ordeformation of the mobile terminal 100 by an external force. The“bending motion” may be a bending movement or deformation of the mobileterminal 100.

For example, in a case where the user bends the top of the mobileterminal 100, the mobile terminal 100 may generate a control signal formoving the selection region one space upward, in a case where the userbends a left region of the mobile terminal 100, the mobile terminal 100may generate a control signal for moving the selection region one spaceto the left, and, in a case where the user bends the whole of the mobileterminal 100, the mobile terminal 100 may generate a control signal forselecting an object including a current selection region.

In a case where the first input is the voice input, the mobile terminal100 may generate a control signal for moving the selection region to alocation corresponding to the voice input. For example, in a case wherethe user says “move three spaces to the left”, the mobile terminal 100may generate a control signal for moving the selection region by threespaces to the left.

In operation S830, the mobile terminal 100 may transmit the signal forselecting the object generated based on the first input to the displaydevice 200. The mobile terminal 100 according to an exemplary embodimentmay transmit the signal for selecting the object to the display device200 directly or through the server 300. The mobile terminal 100according to an exemplary embodiment may also transmit the signal forselecting the object using various communication methods.

For example, in a case where the mobile terminal 100 and the displaydevice 200 are within a predetermined range (local area distance), themobile terminal 100 may transmit the signal for selecting the object tothe display device 200 directly by short-range wireless communication(Bluetooth, Zigbee, near field communication (NFC), Wi-Fi direct (WFD),ultra-wideband (UWB), infrared data association (IrDA), etc.). Themobile terminal 100 may also transmit the signal for selecting theobject over a mobile communication network (for example, 2G/3G/4G,Wibro, etc.) or a wireless local area network (LAN) (Wi-Fi: ad-hoc mode,infrastructure mode).

In operation S840, the display device 200 may move the selection regionbased on the first input of the mobile terminal 100. For example, in acase where the first input is the motion input in which the mobileterminal 100 is moved to the left (−X axial direction), the displaydevice 200 moves the selection region to the left.

According to an exemplary embodiment, the display device 200 may controla movement speed of the selection region based on the first input. Forexample, in a case where the first input is the motion input, if theuser moves the mobile terminal 100 to the right at a speed higher than athreshold speed, the display device 200 may move the selection regionseveral spaces (for example, every 3 spaces) to the right, and, if theuser moves the mobile terminal 100 to the left at a speed lower than thethreshold speed, the display device 200 may move the selection regionone space to the left.

According to an exemplary embodiment, in a case where the first input isthe touch input, if the user drags the touch screen of the mobileterminal 100 at a speed higher than the threshold speed, the displaydevice 200 may move the selection region several spaces, and, if theuser drags the touch screen of the mobile terminal 100 at a speed lowerthan the threshold speed, the display device 200 may move the selectionregion by one space.

According to an exemplary embodiment, in a case where the first input isthe bending input, the display device 200 may control the movement speedof the selection region based on how many times the user bends thepredetermined region of the mobile terminal 100. For example, in a casewhere the user bends the top of the mobile terminal 100 three times, thedisplay device 200 may move the selection region by three spaces upward,and, in a case where the user bends the right region of the mobileterminal 100 twice, the display device 200 may move the selection regionby two spaces to the right. In addition, there are diverse examples inwhich the display device 200 moves the selection region based on thefirst input.

According to an exemplary embodiment, the display device 200 may adjustthe number of objects displayed on the screen based on the first input.For example, in a case where the first input is the motion input, if theuser moves the mobile terminal 100 in a front direction (+Z axialdirection), the display device 200 may reduce the number of objectsdisplayed on the screen, and, if the user moves the mobile terminal 100in a rear direction (−Z axial direction), the display device 200 mayincrease the number of objects displayed on the screen.

According to an exemplary embodiment, in a case where the first input isthe touch input, if the user multi-touches at least two points on thetouch screen of the mobile terminal 100 and drags the two points awayfrom each other, the display device 200 may reduce the number of objectsdisplayed on the screen, and, if the user drags the two points closer toeach other, the display device 200 may increase the number of objectsdisplayed on the screen.

According to an exemplary embodiment, in a case where the first input isthe bending input, if the user bends a center portion of the mobileterminal 100 to be convex, the display device 200 may reduce the numberof objects displayed on the screen, and, if the user bends a centerportion of the mobile terminal 100 to be concave, the display device 200may increase the number of objects displayed on the screen.

In addition, there are diverse examples in which the display device 200adjusts the number of objects displayed on the screen based on the firstinput.

According to an exemplary embodiment, while the display device 200selects an object based on the first input of the mobile terminal 100,the mobile terminal 100 may receive and display thumbnail information ofcontents corresponding to the object in which the selection region isdisposed from the display device 200. For example, the mobile terminal100 may display an image, an icon, a title, a type of contents, etc. ofthe contents corresponding to the object in which the selection regionis disposed. The mobile terminal may display a location of the selectionregion corresponding to a current location of the mobile terminal 100and a movement direction of the selection region on an entire screen ofthe display device 200.

According to another exemplary embodiment, the mobile terminal 100 mayturn its screen off or blacken its screen in such a way that the user'seyes are not distracted from the screen of the display device 200 onwhich the object is selected.

In operation S850, the display device 200 selects the object. Accordingto an exemplary embodiment, the display device 200 may select an objectin which the moved selection region is disposed based on the firstinput.

According to an exemplary embodiment, the display device 200 mayidentify (emphasize) the object in which the selection region isdisposed. For example, the display device 200 may indicate a border ofthe object in which the selection region is disposed as a box, increasea size of the object in which the selection region is disposed comparedto other objects, or make an animation effect such as blinking.

In operation S860, the mobile terminal 100 may receive a second input.The second input according to an exemplary embodiment may be a userinput for obtaining additional information. The second input of themobile terminal 100 according to an exemplary embodiment may include atleast one of a motion input, a key input, a bending input, and a voiceinput. For example, the user may rotate the mobile terminal 100 at apredetermined angle, bend a center portion of the mobile terminal 100,press a selection key of the mobile terminal 100, touch (tap) a GUI onthe screen requesting the additional information, or input a voicerequesting the additional information. The second input is not limitedthereto and there may be diverse examples thereof.

In operation S870, the mobile terminal 100 may request the additionalinformation corresponding to the selected object from the display device200. According to an exemplary embodiment, the mobile terminal 100 mayrequest the additional information from the display device 200 directlyor through the server 300.

According to an exemplary embodiment, the mobile terminal 100 mayrequest the additional information from the display device 200 throughdiverse communication methods such as short-range wireless communication(Bluetooth, Zigbee, NFC, WFD, UWB, IrDA, etc., mobile communication (forexample, 2G/3G/4G, Wibro, etc.) or a wireless LAN (Wi-Fi: ad-hoc mode,infrastructure mode).

In operation S880, the display device 200 may transmit the additionalinformation corresponding to the selected object to the mobile terminal100. For example, in a case where an object related to movie contents isselected, the display device 200 may transmit additional information(representative scenes, preview video, production information, synopsisinformation, actors, director information, user review information,etc.) regarding the movie contents to the mobile terminal 100.

In a case where an object relating to an application is selected, thedisplay device 200 may transmit additional information (for example, anexplanation of the application, application review information,application update information, etc.) regarding the application to themobile terminal 100.

According to an exemplary embodiment, in a case where an object relatingto a photo is selected, the display device 200 may transmit additionalinformation including metadata (for example, a place photograph wastaken, photographing time, etc.) of the photo, information (for example,newspaper articles, appearance movies, representative music, etc.)relating to characters in the photo to the mobile terminal 100.

According to an exemplary embodiment, in a case where an object relatingto music is selected, the display device 200 may transmit additionalinformation including album information, music video, teaser video,prelistening information, newspaper articles, singer information, etc.regarding the music to the mobile terminal 100.

According to an exemplary embodiment, in a case where an object relatingto a Website is selected, the display device 200 may transmit additionalinformation including preview information regarding the Website to themobile terminal 100.

According to an exemplary embodiment, in a case where an object relatingto an EPG is selected, the display device 200 may transmit additionalinformation including a broadcasting program synopsis, previewinformation per episode, etc. regarding the EPG to the mobile terminal100. In a case where an object relating to a shopping item is selected,the display device 200 may transmit additional information includinggoods information, order information, recommendation information, etc.regarding the shopping item to the mobile terminal 100.

According to an exemplary embodiment, the display device 200 maytransmit additional information previously stored in a storage unit tothe mobile terminal 100. If link information of the additionalinformation is only stored in the storage unit, the display device 200may receive the additional information from the server 300 and transmitthe received additional information to the mobile terminal 100. Thedisplay device 200 may search for the additional information relating tothe object in a search engine or a Website and provide the foundadditional information to the mobile terminal 100.

In operation S890, the mobile terminal 100 may display the obtainedadditional information. The mobile terminal 100 may control thedisplayed additional information based on a user input. This will now bedescribed in detail with reference to FIG. 9.

As described above, according to an exemplary embodiment, the user maysearch for and/or select an object relating to contents displayed on theexternal display device 200 through a simple input of the mobileterminal 100 and confirm additional information relating to the selectedobject to determine whether to receive corresponding contents.

FIG. 9 is a flowchart illustrating a method in which the display device200 senses an input of the mobile terminal 100 and provides additionalinformation, according to an exemplary embodiment. Redundantdescriptions between FIGS. 8 and 9 are omitted here.

Referring to FIG. 9, according to an exemplary embodiment, the mobileterminal 100 may receive a first input in operation S910 and the displaydevice 200 may sense the input of the mobile terminal 100.

For example, in operation S920, the display device 200 may sense a firstinput of the mobile terminal 100 for selecting an object. OperationsS930 through S960 of FIG. 9 correspond to operations S810 through S860of FIG. 8, and thus redundant descriptions thereof will be omitted here.In operation S970, the display device 200 may sense a second input ofthe mobile terminal 100 for obtaining additional informationcorresponding to the selected object. Operations S980 through S995 ofFIG. 9 correspond to operations S870 through S890 of FIG. 8, and thusredundant descriptions thereof will be omitted here.

The first input and the second input of the mobile terminal 100 mayinclude at least one of a motion input (for example, a 3D motion input,a rotational motion input, etc.), a key input, a touch input, a bendinginput, and a voice input.

According to an exemplary embodiment, in a case where the first inputand the second input are motion inputs, the display device 200 may sensea motion of the mobile terminal 100 through a camera. For example, in acase where the user moves the mobile terminal 100 up and down and leftand right or rotates the mobile terminal 100, the display device 200 maysense the up and down and left and right motion of the mobile terminal100 or the rotation of the mobile terminal 100.

According to an exemplary embodiment, in a case where the first inputand the second input are bending inputs, the display device 200 maysense a bending motion of the mobile terminal 100 through the camera.For example, the display device 200 may sense a bending location (acoordinate value) of the mobile terminal 100, a bending direction, abending angle, a bending speed, a bending frequency, a bending motionoccurrence time, a bending motion continuance time period, etc.

According to an exemplary embodiment, in a case where the first inputand the second input are touch inputs, the display device 200 may sensea touch gesture of the user through the camera.

According to an exemplary embodiment, in a case where the first inputand the second input are voice inputs, the display device 200 may sensea voice input of the user through a microphone.

That is, according to an exemplary embodiment, the display device 200may sense the first input or the second input to authenticate a signalfor selecting an object received from the mobile terminal 100 or asignal for requesting additional information corresponding to theobject. For example, in a case where the display device 200 senses amotion input in which the mobile terminal 100 moves to the right (+Xaxial direction) and receives a control signal for moving a selectionregion by one space to the left from the mobile terminal, the displaydevice 200 may request the control signal from the mobile terminal 100again or may not follow the control signal for moving the selectionregion by one space to the left.

According to another exemplary embodiment, the display device 200 maysense the first input or the second input to directly generate a controlcommand for moving the selection region for selection of the object, acontrol command for selecting the object, and a control command fortransmitting the additional information to the mobile terminal 100.

FIG. 10 is a flowchart illustrating a method in which the mobileterminal 100 obtains additional information through the server 300,according to an exemplary embodiment. Operations S1005 through S1035 ofFIG. 10 correspond to operations S810 through S870 of FIG. 8, and thusredundant descriptions thereof will be omitted here.

In operation S1035, in a case where the display device 200 receives anadditional information request from the mobile terminal 100 based on asecond input of the mobile terminal 100, in operation S1040, the displaydevice 200 may transmit link information (for example, a URI) of theadditional information to the mobile terminal 100.

In this case, in operation S1045, the mobile terminal 100 requests theadditional information from the server 300 based on the link informationof the additional information. According to an exemplary embodiment, themobile terminal 100 may request additional information from the server300 over a mobile communication network (for example, 2G/3G/4G, Wibro,etc.) or a wireless local area network (LAN) (Wi-Fi: ad-hoc mode,infrastructure mode).

In operation S1050, the mobile terminal 100 may receive the additionalinformation from the server 300. The mobile terminal 100 may receive theadditional information from the server 300 by downloading or streamingit.

In operation S1055, the mobile terminal 100 may display the additionalinformation received from the server 300. In a case where the additionalinformation is a moving image, the display of the additional informationmay include playing thereof.

FIG. 11 is a flowchart illustrating a method in which the mobileterminal 100 obtains contents, according to an exemplary embodiment.

In operation S1110, the mobile terminal 100 may display additionalinformation obtained from the display device 200 or the server 300. Inoperation S1120, the mobile terminal 100 may receive a third input forcontrolling the additional information displayed on a screen.

The third input of the mobile terminal 100 may include at least one of amotion input (for example, a 3D motion input, a rotational motion input,etc.), a key input, a touch input, a bending input, and a voice input.

In operation S1130, the mobile terminal 100 may control the displayedadditional information based on the third input. According to anexemplary embodiment, the mobile terminal 100 may control at least oneof a display of the additional information, playing (or pausing), and achange to previous additional information or next additional informationbased on the third input. For example, the mobile terminal 100 may moveto the previous additional information or the next additionalinformation according to a swipe gesture of the user, a shuffle gesture,a flick gesture, etc.

In operation S1140, the mobile terminal 100 may receive a fourth input.The fourth input according to an exemplary embodiment may be an inputfor obtaining contents corresponding to the additional informationdisplayed on the mobile terminal 100.

The fourth input of the mobile terminal 100 according to an exemplaryembodiment may include at least one of a motion input (for example, a 3Dmotion input, a rotational motion input, etc.), a key input, a touchinput, a bending input, and a voice input.

In operation S1150, the mobile terminal 100 may request contentscorresponding to the additional information from the display device 200based on the fourth input. That is, the user may determine whether toreceive the contents after confirming the additional information relatedto the contents through the mobile terminal 100.

According to an exemplary embodiment, the mobile terminal 100 mayrequest contents corresponding to the additional information from thedisplay device 200 using various types of communication (for example,short-range wireless communication, mobile communication, wirelessInternet communication, etc.)

In operation S1160, the mobile terminal 100 may receive the contentsfrom the display device 200. According to an exemplary embodiment, thedisplay device 200 may transmit contents previously stored in a storageunit to the mobile terminal 100.

In operation S1170, the mobile terminal 100 may display or reproduce theobtained contents or store them in the storage unit.

FIG. 12 is a flowchart illustrating a method in which the mobileterminal 100 obtains contents through the server 300, according to anexemplary embodiment. Operations S1210 through S1230 of FIG. 12correspond to operations S1110, S1140, and S1150 of FIG. 11, and thusredundant descriptions thereof will be omitted here.

In operation S1230, the display device 200 may receive a request forcontents corresponding to additional information based on a fourth inputof the mobile terminal 100 In operation S1240, the display device 200may transmit link information (for example, a URI) of the contentscorresponding to the additional information to the mobile terminal 100.

In this case, in operation S1250, the mobile terminal 100 requests thecontents from the server 300 based on link information of the contents.According to an exemplary embodiment, the mobile terminal 100 mayrequest the contents from the server 300 over a mobile communicationnetwork (for example, 2G/3G/4G, Wibro, etc.) or a wireless LAN (Wi-Fi:ad-hoc mode, infrastructure mode).

The contents according to an exemplary embodiment may include at leastone of a still image (for example, a photo, a picture, a document, ane-book, etc.), a moving image (for example, a movie, a TV broadcastingprogram, a YouTube video, an advertisement (teaser), an image, etc.), anapplication (for example, a game, a household account, a diary, etc.),music (a song, lyrics, a music video, etc.), a webpage, and an EPG.

In operation S1270, the mobile terminal 100 may receive the contentsfrom the server 300. According to an exemplary embodiment, the mobileterminal 100 may receive the contents from the server by downloading orstreaming it (operation S1260).

In operation S1280, the mobile terminal 100 may display or reproduce theobtained contents or store them in the storage unit. In this regard,according to an exemplary embodiment, the mobile terminal 100 mayreceive a user input to control the contents displayed or reproduced onthe screen. For example, the mobile terminal 100 may control playing ofthe contents, pausing, a play speed, a play frequency, skipping, etc.based on at least one of a touch input of the user, a bending input, akey input, a voice input, and a motion input.

FIG. 13 is a view of a screen on which each of a plurality of mobileterminals 100-1, 100-2, and 100-3 selects an object of the displaydevice 200, according to an exemplary embodiment.

Referring to FIG. 13, each of the first through third mobile terminals100-1, 100-2, and 100-3 selects the object of the display device 200.

In this regard, the display device 200 may display the objects selectedbased on a first input of each of the first through third mobileterminals 100-1, 100-2, and 100-3. For example, a border of the objectselected by the first mobile terminal 100-1 may be displayed in bold, aborder of the object selected by the second mobile terminal 100-2 may bedisplayed as a dotted line, and a border of the object selected by thethird mobile terminal 100-3 may be displayed as an alternating long andshort dashed line.

According to an exemplary embodiment, each of the first through thirdmobile terminals 100-1, 100-2, and 100-3 may freely select the objectson the display device 200 or receive additional information of theselected objects without any interference from the other mobileterminals.

The construction of the mobile terminal 100 according to an exemplaryembodiment will now be described in detail with reference to FIG. 14.

FIG. 14 is a block diagram of the mobile terminal 100, according to anexemplary embodiment.

Referring to FIG. 14, the mobile terminal 100 according to an exemplaryembodiment may include a communication unit 110, a user input unit 120(e.g., a user input, etc.), an obtaining unit 130, an output unit 140,an operation mode determining unit 150, a storage unit 160, an interfaceunit 170, a power supply unit 180, and a control unit 190 (e.g.,controller, etc.). However, these elements may not all be essential. Themobile terminal 100 may be implemented with more or less elements thanthe elements of FIG. 14.

The above elements will now be sequentially described below.

The communication unit 110 may include one or more elements forcommunication between the mobile terminal 100 and the display device 200or between networks in which the mobile terminal 100 and the displaydevice 200 are disposed. For example, the communication unit 110 mayinclude a broadcasting receiving module 111, a mobile communicationmodule 112, a wireless Internet module 113, a short-range wirelesscommunication module 114, and a location information module 115.

The broadcasting receiving module 111 may receive a broadcasting signaland/or broadcasting information from an external broadcasting managementserver over a broadcasting channel. The broadcasting channel may includea satellite channel and a terrestrial wave channel. The broadcastingmanagement server may be a server that generates and transmits thebroadcasting signal and/or the broadcasting information or a server thatreceives and transmits a previously generated broadcasting signal and/orbroadcasting information. The broadcasting information may beinformation relating to a broadcasting channel, a broadcasting program,or a broadcasting service provider. The broadcasting signal may includea TV broadcasting signal, a radio broadcasting signal, and a databroadcasting signal as well as a broadcasting signal that is acombination of the TV broadcasting signal or the radio broadcastingsignal and the data broadcasting signal.

The mobile communication module 112 may transmit and receive a wirelesssignal to and from at least one of a base station, the external displaydevice 200, and the server 300 over a mobile communication network. Inthis regard, the wireless signal may include a voice call signal, aconference call signal, or various types of data according totransmission and reception of text and multimedia messages.

The wireless Internet module 113 refers to a module for wirelessInternet access, and may be included in or excluded from the mobileterminal 100.

The short-range wireless communication module 114 refers to a module forshort-range wireless communication. A short-range wireless communicationtechnology may include Wi-Fi, Bluetooth, Zigbee, WFD, UWB, IrDA, etc.but an exemplary embodiment is not limited thereto.

The location information module 115 is a module for confirming orobtaining a location of the mobile terminal 100. An example of thelocation information module 115 may be a global positioning system (GPS)module. The GPS module receives location information from a plurality ofsatellites. In this regard, the location information may includecoordinate information indicated by latitude and longitude. Inparticular, the GPS module may obtain locations of latitude, longitude,and altitude as well as 3D speed information and accurate time from thelocation information received from the satellites.

The communication unit 110 according to an exemplary embodiment mayrequest control authorization from the display device 200 and receive acontrol authorization acceptance message. In this case, thecommunication unit 110 may transmit a control signal to the displaydevice 200. For example, the communication unit 110 may transmit to thedisplay device 200 a signal for selecting at least one object from anobject list displayed on the display device 200. The signal forselecting the object may include a signal for controlling a movement ofa selection region for selecting the object. The selection region may bea region on the display device 200 in which a cursor or a pointer isdisposed.

The communication unit 110 may transmit a signal for controlling atleast one of a movement direction of the selection region, a movementspeed, and the number of objects displayed on the screen of the displaydevice 200 to the display device 200.

The communication unit 110 may receive at least one of additionalinformation corresponding to the object selected by the display device200, link information of the additional information, the object, andlink information of the object from the display device 200. The linkinformation refers to access information regarding a website in whichcontents are disposed. An example of the link information may include auniform resource locator (URL).

The communication unit 110 may receive the additional information fromthe server 300 based on the link information of the additionalinformation. The communication unit 110 may receive the object from theserver based on the link information of the object.

The user input unit 120 is a unit that allows the user to input data forcontrolling the mobile terminal 100. The user input unit 120 may includea key pad, a dome switch, a touch pad (a contact type electrostaticcapacitive method, a pressure resistive layer method, an infrared raysensing method, a surface ultrasonic wave conduction method, anintegration type tension measurement method, a piezo effect method, orthe like), a jog wheel, a jog switch, or the like. In particular, whenthe touch pad configures a layer structure with a display unit 141,which is described below, the touch pad may be referred to as a touchscreen.

The user input unit 120 may include at least one module for receiving aninput of data from the user. For example, the user input unit 120 mayinclude a motion recognition module 121, a touch recognition module 122,a bending motion recognition module 123, a voice recognition module 124,etc.

The motion recognition module 121 may recognize a movement of the mobileterminal 100 and transfer information regarding the movement of themobile terminal 100 to the control unit 190.

The mobile motion recognition module 121 may include diverse sensors forrecognizing the movement of the mobile terminal 100. For example, themobile motion recognition module 121 may include an acceleration sensor,a tilt sensor, a gyro sensor, a 3-axis magnetic sensor, etc.

A motion input according to an exemplary embodiment may include a 3Dmotion input in which the mobile terminal 100 is moved in X-axial,Y-axial, and Z-axial directions, a rotation motion input in which themobile terminal 100 is rotated in at least one direction on a 3D space,and a shaking motion input in which the mobile terminal 100 is shaken inat least one direction.

The touch recognition module 122 may sense a touch gesture on a touchscreen of the user and transfer information regarding the touch gestureto the control unit 190.

Various sensors may be disposed inside or in the vicinity of the touchscreen so as to sense a real-touch or a proximity-touch on the touchscreen. A tactile sensor is an example of a sensor for sensing a touchon the touch screen. The tactile sensor is a sensor for sensing a touchon a particular object at the same degree of human touch sensitivity orhigher. The tactile sensor may sense various types of information, suchas roughness of a touch surface, hardness of a touched object,temperature of a touch point, and the like.

A proximity sensor is an example of a sensor for sensing a touch of thetouch screen.

The proximity sensor refers to a sensor that detects whether an objectapproaches a predetermined detection surface or an object exists in thevicinity of the predetermined detection surface by using a force of anelectronic system or infrared rays without any mechanical touch.Examples of proximity sensors include a transmissive photoelectricsensor, a direct reflective photoelectric sensor, a mirror reflectivephotoelectric sensor, a radio frequency oscillation proximity sensor, anelectrostatic capacitive proximity sensor, a magnetic proximity sensor,an infrared ray proximity sensor, and the like.

The touch gesture of the user may include tap, touch & hold, double tap,drag, panning, flick, drag and drop, and the like.

The bending motion recognition module 123 may sense a bending motion ofthe mobile terminal 100 and transfer information regarding the sensedbending motion to the control unit 190. “Bending” may be a bending ordeformation of the mobile terminal 100 by an external force. The“bending motion” may be a bending movement of the mobile terminal 100.The bending motion according to an exemplary embodiment may be diverse.For example, the bending motion according to an exemplary embodiment mayrefer to all bending movements of the mobile terminal 100 by a foldinggesture made by the user, a rolling gesture, a shaking gesture, abending gesture, etc.

According to an exemplary embodiment, the bending motion recognitionmodule 123 may include a bending sensor for sensing the bending motion.The bending motion recognition module 123 may collect and analyzeinformation regarding the bending motion from a plurality of bendingsensors to sense the bending motion of the mobile terminal 100.

The bending motion recognition module 123 may obtain informationregarding a bending location (a coordinate value) of the mobile terminal100, a bending direction, a bending angle, a bending speed, a bendingfrequency, a bending motion occurrence time, and/or a bending motioncontinuance time with respect to the bending motion.

For example, the bending motion recognition module 123 may calculate thebending location and the bending direction by using a characteristicthat a pressure of a bending part and a pressure of a non-bending partare different from each other. The bending motion recognition module 123may calculate the bending angle, a bending diameter, the bendingfrequency, the bending speed, etc. based on a variation in force of thebending part. The bending motion recognition module 123 may measure aspeed at which each part is modified by using the acceleration sensorand connect locations having a great speed variation to calculate thebending location and the bending angle.

The voice recognition module 124 may recognize a user's voice by using avoice recognition engine and transfer the recognized user's voice to thecontrol unit 190.

The user input unit 120 according to an exemplary embodiment may receivea first input of the mobile terminal 100 for selecting an object of thedisplay device 200, a second input of the mobile terminal 100 forobtaining additional information of the selected object, a third inputof the mobile terminal 100 for controlling the additional informationdisplayed on the mobile terminal 100, and a fourth input of the mobileterminal 100 for obtaining contents corresponding to the additionalinformation.

The first input, the second input, the third input, and the fourth inputof the mobile terminal 100 may include at least one of a motion input, akey input, a touch input, a bending input, and a voice input.

According to an exemplary embodiment, the first input, the second input,the third input, and the fourth input of the mobile terminal 100 may bethe same type of inputs or different types of inputs. For example, thefirst input and the second input of the mobile terminal 100 may be themotion inputs, the third input thereof may be the touch input, and thefourth input thereof may be the voice input.

The obtaining unit 130 may obtain data from the outside. The obtainingunit 130 may include an additional information obtaining unit 131 and acontents obtaining unit 132. The additional information obtaining unit131 may request additional information corresponding to the objectselected by the display device 200 from the display device 200. In thiscase, the additional information obtaining unit 131 may receive theadditional information or link information of the additional informationfrom the display device 200.

If the link information of the additional information is received, theadditional information obtaining unit 131 may access the server 300 toobtain the additional information based on the link information of theadditional information.

The contents obtaining unit 132 may request contents corresponding tothe object selected by the display device 200 from the display device200. The contents obtaining unit 132 may receive contents or linkinformation of the contents from the display device 200. In the linkinformation of the contents is received, the additional informationobtaining unit 131 may access the server 300 to obtain the contentsbased on the link information of the contents.

The output unit 140 is used to output an audio signal, a video signal,or an alarm signal, and may include the display unit 141, a sound outputmodule 142, and an alarm unit 143.

The display unit 141 displays information processed by the mobileterminal 100. For example, the display unit 141 may display theadditional information corresponding to the object selected by thedisplay device 200, the contents corresponding to the object selected bythe display device 200, and thumbnail information of the contentscorresponding to the object selected by the display device 200 on thescreen.

The thumbnail information of the contents is schematic informationindicating the contents corresponding to the selected object and mayinclude, for example, an icon of the contents, a title, a type,identification information, etc.

As described above, in a case where the display unit 141 and the touchpad have a layer structure and are configured as a touch screen, thedisplay unit 141 may be used as an input unit, as well as an outputunit. The display unit 141 may include at least one selected from thegroup consisting of a liquid crystal display (LCD), a thin filmtransistor-liquid crystal display (TFT-LCD), an organic light-emittingdiode (OLED), a flexible display, a three-dimensional (3D) display, andan electrophoretic display. The output unit 140 may include two or moredisplay units 141 according to an implementation type of the mobileterminal 100.

The sound output module 142 receives a call signal and outputs audiodata that is received from the wireless communication unit 110 or thatis stored in the storage unit 160 in a calling or recording mode, avoice recognition mode, a broadcasting reception mode, etc. The soundoutput module 142 outputs a sound signal relating to a function (forexample, a call signal receiving sound, a message receiving sound, etc.)performed by the mobile terminal 100. The sound output module 142 mayinclude a speaker, a buzzer, etc.

The alarm unit 143 outputs a signal for notifying the user about anoccurrence of an event of the mobile terminal 100. An example of theevent that occurs in the mobile terminal 100 may include call signalreception, message reception, a key signal input, object selection, etc.The alarm unit 143 may output a signal for informing the user about theoccurrence of the event in a different form other than the audio signalor the video signal. For example, the alarm unit 143 may output a signalin a vibration form. In a case where the call signal is received or amessage, contents, and/or additional information are received, the alarmunit 143 may output a vibration to notify the user about the receivingof the call signal or the message, contents, and/or additionalinformation. Alternatively, in a case where a key signal, a touchgesture, and a bending gesture are input, the alarm unit 143 may outputthe vibration as feedback of the input of the key signal, the touchgesture, and the bending gesture. The user may recognize the occurrenceof the event through the above-described output of the vibration. Thesignal for notifying the user about the occurrence of the event may beoutput through the display unit 141 or the voice output module 142.

The operation mode determining unit 150 may determine an operation modeof the mobile terminal 100. Examples of the operation mode may include amode in which the object of the display device 200 is selected, a modein which contents corresponding to the selected object are displayed,etc.

According to an exemplary embodiment, the operation mode determiningunit 150 determines the operation mode as a first mode (for example, themode in which the object of the display device 200 is selected) in acase where the mobile terminal 100 is a vertical mode, and determinesthe operation mode as a second mode (for example, the mode in which theobject of the display device 200 is selected) in a case where the mobileterminal 100 is in a horizontal mode.

According to an exemplary embodiment, the operation mode determiningunit 150 may determine the operation mode of the mobile terminal 100based on information displayed on the screen. For example, the operationmode determining unit 150 may determine the operation mode as the firstmode in a case where the information displayed on the screen of themobile terminal 100 is thumbnail information of the contentscorresponding to an object displayed on the display device 200 ormovement direction information of the mobile terminal 100. In a casewhere the information displayed on the screen of the mobile terminal 100is the contents corresponding to the object displayed on the displaydevice 200 or the additional information corresponding to the object,the operation mode determining unit 150 may determine the operation modeas the second mode.

The storage unit 160 may store a program for processing or controllingthe control unit 190. The storage unit 160 may perform a function ofstoring input and output data. For example, the input and output datamay include contents (for example, a still image, a moving image, music,a document, an application, link information, etc.) obtained from thedisplay device 200, contents obtained from the server 300, etc.

The storage unit 160 may include at least one storage medium selectedfrom the group consisting of flash memory, hard disk type memory,multimedia card micro type memory, card type memory (for example, SDmemory, XD memory, or the like), random access memory (RAM), static RAM(SRAM), read-only memory (ROM), electrically erasable programmableread-only memory (EEPROM), programmable ROM (PROM), magnetic memory, amagnetic disk, and an optical disk. In addition, the mobile terminal 100may operate as a web storage facilitator for performing a storingfunction on the Internet.

The interface unit 170 interfaces with all external devices connected tothe mobile terminal 100. For example, the interface unit 170 may includea wired/wireless headset port, an external charger port, awired/wireless data port, a memory card port, a port for connecting anapparatus including an identification module, an audio input/output(I/O) port, a video I/O port, an earphone port, etc.

In this regard, the identification module is a chip for storing varioustypes of information used to authenticate user authorization of themobile terminal 100, and may include a user identity module (UIM), asubscriber identity module (SIM), a universal subscriber identity module(USIM), etc.

The power supply unit 180 supplies power necessary for operations ofelements by receiving internal and external power under the control ofthe control unit 190.

The control unit 190 controls the overall operation of the mobileterminal 100. That is, the control unit 190 may generally control thecommunication unit 110, the user input unit 120, the obtaining unit 130,the output unit 140, the operation mode determining unit 150, thestorage unit 160, the interface unit 170, and the power supply unit 180.

The control unit 190 may convert the signal for selecting the objectaccording to a control protocol of the display device 200. That is, thecontrol unit 190 may move a selection region or generate a controlsignal for selecting the object in the control protocol recognizable bythe display device 200 according to a type of the display device 200.

The control unit 190 according to an exemplary embodiment may controlthe additional information or the contents displayed on the mobileterminal 100. For example, the control unit 190 may control a display (adisplayed region, a displayed size, etc.) of the additional information,playing, pausing, changing to previous or next additional information,etc.

The control unit 190 may generate a first control signal for controllingthe display device 200 or may selectively generate a second controlsignal for controlling the contents displayed on the mobile terminal 100according to the operation mode of the mobile terminal 100. According toan exemplary embodiment, the first control signal may include a signalfor controlling a movement of a selection region for selecting theobject of the display device 200, and the second control signal mayinclude a signal for controlling at least one of the playing of thecontents, editing, and transmission.

The control unit 190 may change the operation mode of the mobileterminal 100 based on a rotation motion of the mobile terminal 100. Forexample, the control unit 190 may change the operation mode of themobile terminal 100 from the first mode to the second mode based on afirst rotation motion input and from the second mode to the first modebased on a second rotation motion input.

Various embodiments described herein may be implemented in acomputer-readable recording medium by using, for example, software,hardware, or a combination thereof.

The embodiments described herein may be implemented in hardware by usingat least one of application specific integrated circuits (ASICs),digital signal processors (DSPs), digital signal processing devices(DSPDs), programmable logic devices (PLDs), field programmable gatearrays (FPGAs), processors, controllers, micro-controllers,microprocessors, and electrical units for performing a function. In somecases, such embodiments may be implemented by the control unit 190.

The embodiments regarding procedures or functions may be implemented insoftware with a separate software module that enables at least onefunction or operation. Software codes may be implemented by a softwareapplication in an appropriate program language. Software codes may bestored in the storage unit 160 and may be executed by the control unit190.

FIG. 15 is a block diagram of the display device 200, according to anexemplary embodiment.

Referring to FIG. 15, the display device 200 according to an exemplaryembodiment may include a communication unit 210, a selection unit 220,an output unit 230, a sensing unit 240, a storage unit 250, and acontrol unit 260. However, these elements may not all be essential. Thedisplay device 200 may be implemented with more or less elements thanthe elements of FIG. 15.

The above elements will now be sequentially described below.

The communication unit 210 may include one or more elements forcommunication between the mobile terminal 100 and the display device 200or between networks in which the mobile terminal 100 and the displaydevice 200 are disposed. For example, the communication unit 210 mayinclude a broadcasting receiving module 211, a wireless Internet module212, a wired Internet module 213, and a short-range wirelesscommunication module 214.

The broadcasting receiving module 211 may receive a broadcasting signaland/or broadcasting information from an external broadcasting managementserver over a broadcasting channel. The broadcasting channel may includea satellite channel and a terrestrial wave channel.

The wireless Internet module 212 is a module for wireless Internetaccess, and may be included in or excluded from the display device 200.

The short-range wireless communication module 214 is a module forshort-range wireless communication. A short-range wireless communicationtechnology may include Wi-Fi, Bluetooth, Zigbee, WFD, UWB, IrDA, etc.but an exemplary embodiment is not limited thereto.

The communication unit 210 according to an exemplary embodiment mayrequest control authorization from the mobile terminal 100 and receive acontrol authorization acceptance/ignore message to the mobile terminal100 in response to the request.

The communication unit 210 may transmit additional information orcontents corresponding to an object displayed on the display device 200to the mobile terminal 100. In this regard, the communication unit 210may transmit additional information or contents previously stored in thestorage unit 250 to the mobile terminal 100 or search for the additionalinformation or contents in the server 300 and provide the additionalinformation or contents to the mobile terminal 100. The communicationunit 210 may also transmit link information (for example, a URL) of theadditional information and link information (for example, a URL) of thecontents to the mobile terminal 100.

The selection unit 220 may select the object displayed on the displaydevice 200 based on a first input of the mobile terminal 100. Forexample, the selection unit 220 may receive a control signal forcontrolling a movement of a selection region for selecting the objectfrom the mobile terminal 100 based on the first input of the mobileterminal 100. The selection unit 200 may select the object by moving theselection region according to the received control signal.

The output unit 230 is used to output an audio signal, a video signal,or an alarm signal, and may include a display unit 231, a sound outputmodule 232, and an alarm unit 233. The display unit 231 displaysinformation processed by the display device 200. For example, thedisplay device 200 may display an object list. The object list mayinclude an image indicating contents, an icon, a title, etc. The objectlist may be displayed in a GUI form.

According to an exemplary embodiment, the display unit 231 may displayan indication for selecting the object based on the first input of themobile terminal 100 on a screen. For example, the display unit 231 mayindicate a border of an object in which the selection region is shown asa box, increase a size of the object compared to other objects, or makethe object blink on and off.

The sound output module 232 outputs audio data received through thecommunication unit 210 or stored in the storage unit 250. The soundoutput module 232 may include a speaker, a buzzer, etc.

The alarm unit 233 outputs a signal for notifying an occurrence of anevent of the display device 200. An example of the event that occurs inthe display device 200 may include power on/off, message reception,complete reception of broadcasting contents, object selection, etc.

The sensing unit 240 may sense a user input of the mobile terminal 100.For example, the sensing unit 240 may sense at least one of the firstinput of the mobile terminal 100 for selecting the object displayed onthe display device 200 and a second input for obtaining additionalinformation of the selected object.

The sensing unit 240 according to an exemplary embodiment may include acamera 241 and a microphone 242. The camera 241 according to anexemplary embodiment 241 may include a depth camera, a multi-viewcamera, etc. The depth camera measures distances between objects in ascene in real time by using a time-of-flight (TOF) technology. Themeasured distance values may be output as depth images and used tomanufacture a high quality depth map of the scene, along with abinocular camera or the multi-view camera.

In a case where the user input of the mobile terminal 100 is a motioninput or a bending input, the sensing unit 240 may sense a movement ofthe mobile terminal 100 or a bending motion thereof through the camera241.

In a case where the user input of the mobile terminal 100 is a voiceinput, the sensing unit 240 may recognize or analyze a user's voicethrough the microphone 242.

The storage unit 250 may store a program for processing or controllingthe control unit 260. The storage unit 250 may perform a function ofstoring input and output data. For example, the input and output datamay include contents (for example, a still image, a moving image, music,a document, an application, link information, etc.) obtained from theserver 300.

The storage unit 250 may include at least one storage medium selectedfrom the group consisting of flash memory, hard disk type memory,multimedia card micro type memory, card type memory (for example, SDmemory, XD memory, or the like), RAM, SRAM, ROM, EEPROM, PROM, magneticmemory, a magnetic disk, and an optical disk. In addition, the displaydevice 200 may operate as a web storage facilitator for performing astoring function on the Internet.

The control unit 260 controls the overall operation of the displaydevice 200. That is, the control unit 260 may generally control thecommunication unit 210, the selection unit 220, the output unit 230, thesensing unit 240, and the storage unit 250.

The control unit 260 according to an exemplary embodiment may control amovement direction of the selection region for selecting the object, amoving speed of the selection region, and the number of objectsdisplayed on the screen of the display device 200 based on the firstinput of the mobile terminal 100. For example, in a case where the usermoves the mobile terminal up and down and left and right, the selectionregion on the display device 200 may be moved up and down left andright, and, in a case where the user moves the mobile terminal 100 fast,the selection region may be moved by several spaces. In a case where theuser moves the mobile terminal 100 in a +Z axial direction, the numberof objects displayed on the screen of the display device 200 mayincrease, and, in a case where the user moves the mobile terminal 100 ina −Z axial direction, the number of objects displayed on the screen ofthe display device 200 may decrease.

According to an exemplary embodiment, the control unit 260 may convertthe first input received from the mobile terminal 100 to the controlsignal for controlling the movement of the selection region according toa control protocol of the display device 200. For example, the controlunit 260 may generate the control signal for moving the selection regionby one space every time a predetermined gyro sensor value (for example,10 deg/sec) greater than a threshold value is received from the mobileterminal 100.

According to an exemplary embodiment, the control unit 260 may extractadditional information from the contents corresponding to the selectedobject.

FIG. 16 is a flowchart illustrating a method in which the display device200 provides information, according to an exemplary embodiment.Referring to FIG. 16, the method in which the display device 200provides information according to an exemplary embodiment includesoperations sequentially performed by the display device 200 of FIG. 15.Thus, although omitted below, the above descriptions regarding thedisplay device 200 of FIG. 15 may also apply to the method in which thedisplay device 200 provides information of FIG. 16.

In operation S1610, the display device 200 may receive a first input ofthe mobile terminal 100 and select at least one object displayed on ascreen. The first input of the mobile terminal 100 according to anexemplary embodiment may include at least one of a motion input, a keyinput, a touch input, a bending input, and a voice input. For example, auser may select at least one object displayed on the screen of thedisplay device 200 through a 3D motion input for moving the mobileterminal 100 in 3D directions of X, Y, and Z axes.

According to an exemplary embodiment, the display device 200 may receivea signal that is generated by the mobile terminal 100 based on the firstinput of the mobile terminal 100 and controls a movement of a selectionregion from the mobile terminal 100. That is, the signal for controllingthe movement of the selection region according to an exemplaryembodiment may be a signal converted to a control protocol of thedisplay device 200 in the mobile terminal 100. The display device 200may move the selection region according to the control signal receivedfrom the mobile terminal 100 and select an object.

According to another exemplary embodiment, the display device 200 mayconvert the received first input to the control signal for controllingthe movement of the selection region based on the control protocol ofthe display device 200. That is, in a case where a signal that is notconverted to the control protocol of the display device 200 is receivedfrom the mobile terminal 100, the display device 200 may convert thereceived signal to the control protocol thereof.

According to an exemplary embodiment, the display device 200 may receivethe control signal for controlling the movement of the selection regionfrom each of a plurality of mobile terminals.

According to an exemplary embodiment, the display device 200 may sensethe first input of the mobile terminal 100 through the camera 241. Inthis regard, the display device 200 may directly generate a controlcommand for controlling the movement of the selection region and acontrol command for selecting the object based on the sensed first inputof the mobile terminal 100. According to another exemplary embodiment,the display device 200 may authenticate a signal for selecting theobject received from the mobile terminal 100 by sensing the first inputof the mobile terminal 100.

According to an exemplary embodiment, the display device 200 may controlat least one of a movement direction of the selection region forselecting the object, a movement speed of the selection region, and thenumber of objects displayed on the screen based on the first input ofthe mobile terminal 100.

For example, in a case where the mobile terminal 100 is moved in a leftdirection, a left region of the mobile terminal 100 is bent, a finger oran electronic pen is dragged in the left direction on a touch screen ofthe mobile terminal 100, a left direction key is pressed, or a voicesaying “left movement” is input, the display device 200 may move theselection region to the left.

The display device 200 may increase or decrease the movement speed ofthe selection region based on the movement speed of the mobile terminal100, a bending frequency of the mobile terminal 10, a movement speed ofa touch gesture, etc. That is, the display device 200 may move theselection region by one space or several spaces.

According to an exemplary embodiment, in a case where the mobileterminal 100 is moved in a +Z axial direction, the display device 200may increase the number of objects displayed on the screen, and, in acase where the mobile terminal 100 is moved in a −Z axial direction, thedisplay device 200 may decrease the number of objects displayed on thescreen.

The display device 200 may transmit thumbnail information of contentscorresponding to the object to the mobile terminal 100. For example, thedisplay device 200 may transmit an icon of the contents corresponding toan object in which the selection region is disposed, an image, a title,a type, identification information, etc. to the mobile terminal 100while selecting the object.

In operation S1620, the display device 200 may transmit additionalinformation corresponding to the selected object to the mobile terminal100 based on a second input of the mobile terminal 100. The second inputof the mobile terminal 100 according to an exemplary embodiment may bean input for requesting the additional information corresponding to theselected object.

The second input of the mobile terminal 100 according to an exemplaryembodiment may include at least one of a motion input, a bending input,a key input, a voice input, and a touch input. For example, the secondinput of the mobile terminal 100 may be a rotational motion input forrotating the mobile terminal 100 by more than a predetermined angle.

According to an exemplary embodiment, the display device 200 may sensethe second input of the mobile terminal 100. In this case, the displaydevice 200 may transmit the additional information to the mobileterminal 100 based on the second input even though an additionalinformation request is not received from the mobile terminal 100.

According to an exemplary embodiment, the display device 200 maytransmit additional information stored in the storage unit 250 orextract additional information from the contents corresponding to theselected object and transmit the extracted additional information to themobile terminal 100. The display device 200 may receive additionalinformation from the server 300 based on link information of theadditional information and transmit the received additional informationto the mobile terminal 100.

The additional information according to an exemplary embodiment mayinclude preview information, prelistening information, applicationinformation, user review information, update information, newspaperarticle information, goods information, movie information, gameinformation, advertisement image information, and album information.

In operation S1630, the display device 200 may receive a request for atransmission of contents corresponding to the additional informationdisplayed on the screen of the mobile terminal 100 from the mobileterminal 100. That is, in a case where a user likes additionalinformation of contents, the user may download the correspondingcontents.

In operation S1640, the display device 200 may transmit the contents tothe mobile terminal 100. In this regard, according to an exemplaryembodiment, the display device 200 may transmit contents stored in thestorage unit 250 to the mobile terminal 100 or receive contents from theserver and transmit the received contents to the mobile terminal 100.The display device 200 may transmit link information from which contentsmay be downloaded to the mobile terminal 100.

FIG. 17 is a flowchart illustrating a method in which the mobileterminal 100 generates a control signal, according to an exemplaryembodiment. Referring to FIG. 17, the method in which the mobileterminal 100 generates the control signal according to an exemplaryembodiment includes operations sequentially performed by the mobileterminal 100 of FIG. 14. Thus, although omitted below, the abovedescriptions regarding the mobile terminal 100 of FIG. 14 will alsoapply to the method in which the mobile terminal 100 generates thecontrol signal of FIG. 17.

In operation S1710, the mobile terminal 100 may receive a user input.The user input according to an exemplary embodiment may include at leastone of a motion input, a key input, a touch input, a bending input, anda voice input.

In operation S1720, the mobile terminal 100 may determine an operationmode thereof. The operation mode according to an exemplary embodimentmay include a mode in which the display device 200 is controlled (afirst mode) and a mode in which the mobile terminal 100 is controlled (asecond mode). For example, the operation mode may include a mode inwhich an object of the display device 200 is selected, a mode in whichadditional information corresponding to the selected object is displayedon the mobile terminal 100, a mode in which contents corresponding tothe additional information is displayed on the mobile terminal 100, etc.

According to an exemplary embodiment, the mobile terminal 100 maydetermine the operation mode as the first mode (for example, the objectselection mode) in a case where the mobile terminal 100 is a verticalmode, and may determine the operation mode as a second mode (forexample, the additional information display mode) in a case where themobile terminal 100 is in a horizontal mode.

According to another exemplary embodiment, the mobile terminal 100 maydetermine the operation mode of the mobile terminal 100 based oninformation displayed on a screen of the mobile terminal 100. Forexample, in a case where the information displayed on the screen of themobile terminal 100 is thumbnail information of contents correspondingto an object displayed on the display device 200 or movement directioninformation of the mobile terminal 100, the mobile terminal 100 maydetermine the operation mode thereof as the first mode, and, in a casewhere the information displayed on the screen of the mobile terminal 100is the contents corresponding to the object displayed on the displaydevice 200 or additional information corresponding to the object, themobile terminal 100 may determine the operation mode thereof as thesecond mode.

In operation S1730, in a case where the operation mode of the mobileterminal 100 is the first mode, the mobile terminal 100 may generate afirst control signal for controlling the external display device 200based on the user input of the mobile terminal 100.

The first mode according to an exemplary embodiment may be a mode inwhich the object of the display device 200 is selected. The firstcontrol signal according to an exemplary embodiment may include a signalfor controlling a movement of a selection region for selecting theobject of the display device 200. That is, if the user input is receivedin the first mode, the mobile terminal 100 may convert the received userinput to the signal for controlling the movement of the selection regionfor selecting the object.

For example, in the first mode, in a case where a motion input formoving the mobile terminal 100 in an upper direction (+Y direction) isreceived or a touch input for dragging a touch screen in the upperdirection is received, the mobile terminal 100 may generate a controlsignal for moving the selection region for selecting the object by onespace upward.

According to an exemplary embodiment, the mobile terminal 100 mayconvert the first control signal to a control protocol of the displaydevice 200.

In operation S1740, in a case where the operation mode of the mobileterminal 100 is the second mode, the mobile terminal 100 may generate asecond control signal for controlling the contents displayed on themobile terminal 100 based on the user input.

The second mode according to an exemplary embodiment may be a mode inwhich the additional information corresponding to the selected object isdisplayed on the mobile terminal 100. The second control signalaccording to an exemplary embodiment may include a signal forcontrolling at least one of a playing/pausing of the contents, editing(move, store, copy, delete, etc.), and a transmission. That is, if theuser input is received in the second mode, the mobile terminal 100 mayconvert the received user input to a control signal for controlling thecontents.

For example, in the second mode, in a case where a motion input formoving the mobile terminal 100 in the upper direction (+Y direction) isreceived or a touch input for dragging the touch screen in the upperdirection is received, the mobile terminal 100 may generate a controlsignal for stopping playing of the contents.

The contents controlled in the second mode according to an exemplaryembodiment may include the contents corresponding to the object selectedby the display device 200 based on the first control signal and theadditional information corresponding to the object.

The contents according to an exemplary embodiment may include at leastone of a still image, a moving image, an application, music, a webpage,and an EPG. The additional information according to an exemplaryembodiment may include at least one of preview information, prelisteninginformation, application information, user review information, updateinformation, newspaper article information, goods information, movieinformation, game information, advertisement image information, andalbum information.

According to an exemplary embodiment, the mobile terminal 100 mayreceive a first rotational motion input for rotating the mobile terminal100 in a first direction by a predetermined angle (for example, ±90degrees). In this case, the mobile terminal 100 may convert theoperation mode from a first mode to a second mode based on the firstrotational motion input.

In a case where a second rotational motion input for rotating the mobileterminal 100 in a second direction by a predetermined angle (forexample, −90 degrees) is received, the mobile terminal 100 may convertthe operation mode from the second mode to the first mode based on thesecond rotational motion input.

For example, in a case where a user rotates the mobile terminal 100 in avertical mode by 90 degrees in a clockwise direction and changes thevertical mode to a horizontal mode, the operation mode of the mobileterminal 100 may be changed from the object selection mode to theadditional information display mode. To the contrary, in a case where auser rotates the mobile terminal 100 in the horizontal mode by 90degrees in a counterclockwise direction and changes the horizontal modeto the vertical mode, the operation mode of the mobile terminal 100 maybe changed from the additional information display mode to the objectselection mode.

According to another exemplary embodiment, the mobile terminal 100 maydisplay a GUI (for example, an icon) for converting the (operation?)mode on the screen. In this regard, in a case where the user selects (ortouches) a mode conversion icon, the mobile terminal 10 may convert theoperation mode from the first mode to the second mode or from the secondmode to the first mode.

The method may be performed by program commands that may be executed ina computer and can be recorded on a computer-readable recording medium.Examples of the computer-readable recording medium can include programcommands, data files, data structures, and the like in a single orcombination form. The program commands recorded on the computer-readablerecording medium may be particularly designed and configured for tanexemplary embodiment. Examples of the computer-readable recordingmediums include hardware devices that are particularly configured tostore and execute program commands, such as hard disks, floppy disks,magnetic media, such as magnetic tapes, optical media, such as CD-ROMsor DVDs, magneto-optical media, such as floptical disks, read-onlymemory (ROM), random-access memory (RAM), flash memory, etc. Examples ofthe program commands include advanced language codes that may beexecuted in a computer by using an interpreter, as well as mechanicallanguage codes that are made by a compiler.

According to an exemplary embodiment, the user may easily search for andselect an object from a display device (for example, a TV set) that isinconvenient in terms of a user input by using the mobile terminal 100,and may confirm additional information regarding contents selectedthrough the mobile terminal 100 in advance.

According to an exemplary embodiment, if the user confirms a preview ona screen of the mobile terminal 100 through a movement of the mobileterminal 100 and selects downloading of contents, even if the usercarries the mobile terminal 100 and goes out, the contents may beseamlessly downloaded.

While exemplary embodiments have been particularly shown and describedwith reference to the drawings, it will be understood by those ofordinary skill in the art that various changes in form and details maybe made therein without departing from the spirit and scope of theinventive concept as defined by the appended claims. The exemplaryembodiments should be considered in descriptive sense only and not forpurposes of limitation. Therefore, the scope of the inventive concept isdefined not by the detailed description but by the appended claims, andall differences within the scope will be construed as being included inthe inventive concept.

What is claimed is:
 1. A mobile device comprising: a display; acommunication interface; and a processor configured to: control thecommunication interface to transmit, to an external display device, asignal for selecting an object from among a plurality of objects basedon a first input of a user through the mobile device; control thecommunication interface to receive additional information correspondingto the object; control the display to display information related to theobject based on the additional information, and control thecommunication interface to request a content corresponding to theinformation related to the object; and control the communicationinterface to receive the content corresponding to the information. 2.The mobile device of claim 1, wherein the processor is furtherconfigured to control the communication interface to request, to theexternal display device, the additional information corresponding to theobject based on a second input of the user through the mobile device,and the additional information including the information related to theobject.
 3. The mobile device of claim 1, wherein the processor isfurther configured to control the mobile device to convert the signalfor selecting the object according to a control protocol of the externaldisplay device.
 4. The mobile device of claim 1, wherein the processoris further configured to control the communication interface to transmita signal for controlling a movement of a selection region for selectingthe object from among the plurality of objects displayed on the externaldisplay device.
 5. The mobile device of claim 4, wherein the processoris further configured to control the communication interface to transmita signal for controlling at least one from among a movement direction ofthe selection region, a movement speed of the selection region, and thenumber of objects displayed on a screen of the external display devicebased on a input of the user.
 6. The mobile device of claim 4, whereinthe processor is further configured to control the display to displaythumbnail information corresponding of the object in which the selectionregion is disposed prior to the requesting of the additionalinformation.
 7. The mobile device of claim 1, wherein the processor isfurther configured to control the communication interface to receivelink information as the additional information from the external displaydevice and to receive the content from a server based on the receivedlink information.
 8. The mobile device of claim 1, wherein the processoris further configured to control the communication interface to requestthe content based on a third input of the user through the mobiledevice.
 9. The mobile device of claim 1, wherein the processor isfurther configured to control the communication interface to requestcontrol authorization from the external display device and receive acontrol authorization acceptance message from the external displaydevice prior to the transmitting of the signal for selecting the object.10. The mobile device of claim 1, wherein the plurality of objectscomprise at least one from among an icon, a link, a picture, a text, andan index item
 11. The mobile device of claim 1, wherein the contentcomprise at least one from among a still image, a moving image, anapplication, music, a web page, and an electronic program guide (EPG).12. The mobile device of claim 1, wherein the additional informationcomprises at least one from among preview information, prelisteninginformation, application information, user review information, updateinformation, newspaper article information, goods information, movieinformation, game information, advertisement image information, andalbum information.
 13. The mobile device of claim 1, wherein theprocessor is further configured to control the mobile device todetermine an operation mode of the mobile device; and in response todetermining the operation mode is a first mode, generate a first signalfor controlling the external display device based on a user input, and,in response to determining the operation mode is a second mode, generatea signal for controlling the content displayed on the mobile devicebased on the user input.
 14. A method in which a mobile device displaysinformation, the method comprising: transmitting, to an external displaydevice, a signal for selecting an object from among a plurality ofobjects based on a first input of a user through the mobile device;receiving additional information corresponding to the object; displayinginformation related to the object based on the additional information;requesting a content corresponding to the information related to theobject; and receiving the content corresponding to the information. 15.The method of claim 14, wherein the transmitting the signal forselecting the object comprises transmitting a signal for controlling amovement of a selection region for selecting the object from among theplurality of objects displayed on the external display device.
 16. Themethod of claim 15, wherein the transmitting the signal for controllingthe movement of the selection region comprises transmitting a signal forcontrolling at least one from among a movement direction of theselection region, a movement speed of the selection region, and thenumber of objects displayed on a screen of the external display devicebased on a input of the user.
 17. The method of claim 15, furthercomprising displaying thumbnail information corresponding of the objectin which the selection region is disposed prior to the requesting of theadditional information.
 18. The method of claim 14, wherein thereceiving the additional information comprises receiving linkinformation from the external display device and, wherein the receivingthe content comprises receiving the content from a server based on thereceived link information.
 19. The method of claim 14, furthercomprising: determining an operation mode of the mobile device; and inresponse to determining the operation mode is a first mode, generating afirst signal for controlling the external display device based on a userinput, and, in response to determining the operation mode is a secondmode, generating a signal for controlling the content displayed on themobile device based on the user input.
 20. A non-transitorycomputer-readable recording medium having recorded thereon a program forexecuting a method in which a mobile device displays information,wherein the method comprising: transmitting, to an external displaydevice, a signal for selecting an object from among a plurality ofobjects based on a first input of a user through the mobile device;receiving additional information corresponding to the object; displayinginformation related to the object based on the additional information;requesting a content corresponding to the information related to theobject; and receiving the content corresponding to the information.